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A method and apparatus for converting a monoscopic image 
with one perspective to a stereoscopic image with two perspectives is 
provided. A foreground object is identified and outlined. The depth of 
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METHOD AND APPARATUS FOR MONOSCOPIC 
TO STEREOSCOPIC IMAGE CONVERSION 

Backgrou nd of thft Invention 

This invention relates to a method and an 
5 apparatus for converting monoscopic (i.e., two- 
dimensional) images into stereoscopic (i.e., three- 
dimensional) images, and more particularly using image 
warping. 

The human brain perceives depth by receiving two 
10 different images, which are horizontally shifted relative 
to each other, from each eye. Such depth information is 
important for determining how far away an object is and 
the depth arrangements between various .objects in a scene. 
Unfortunately, most images are recorded in monoscopic 
15 format on recording medium (e.g., motion picture film and 
video media) where some depth information is lost. 
However, even a monoscopic camera lens produces an image 
according to the laws of Cartesian space and perspective. 
If such an image could be processed to extract that 
20 information, and thus be converted into three-dimensional 
stereoscopic format, there could be a vast amount of 
stereoscopic material available for three-dimensional 
viewing . 
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There are several methods to generate 
stereoscopic images from monoscopic images. One method, 
the horizontal shift method, isolates several important 
objects in the image field and shifts them horizontally. 
5 B.J. Garcia, Ph.D. and R.J. Greenstein, M.D., "True- 
Stereoscopic Video Media from Monoscopic Sources: The 
DeepVision System for Minimally Invasive Surgery," Medical 
Applications,, Virtual Reality Systems , pp. 52-57 (1994). 
The amount of the shift for each object varies according 

10 to its depth arrangement. The depth arrangement (also 
referred to as stereoscopic depth cue or binocular 
disparity) of an object can be set manually using cues 
such as shadows and the perspective within the monoscopic 
image. This process creates a stereoscopic image with 

15 depth perception between objects, but the objects 

themselves lack depth and appear to be flat cardboard 
cutouts . 

Another method, the frame delay method, uses 
moving images to extract a second perspective. " H. Murata, 

2 0 T. Okino, T. Iinuma, S. Yamashita, S. Tanase, K. Terada 

and K . Kanatani, "Conversion of Two-Dimensional Images to 
Three Dimensions , " SID 95 Digest, Society for Information 
Display 1995 Symposium Proceedings (1995) . When an object 
is in motion, a series of different perspectives is 

25 generated due to either the object's movement or the 

camera 1 s motion. Different perspectives from different 
images in a time series can then be extracted to generate 
a second perspective for the stereoscopic effect. Though 
this technique can create very realistic three-dimensional 

30 effects, it requires that motion of both the camera and 
the objects be limited to a direction horizontal to the 
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image frame's horizontal axis. The camera must move in a 
horizontal fashion perpendicular to the subject matter 
(this is called a "truck" in the motion picture industry) . 
The reason for this perpendicular motion is that each 
5 stereoscopic image pair is formed by pairing up images 
which are delayed from each other. Because the camera is 
limited to sideways motion, the delay between images 
results in a parallel camera separation. If the camera 
were not moving in a perpendicular and horizontal manner, 

10 the image pairs would not be parallel and would not form a 
good stereoscopic image. Also, since this technique 
requires a series of images taken at different times, a 
single image cannot be converted. 

In view of the foregoing, it would be desirable 

15 to be able to provide a method and an apparatus for 
converting monoscopic images into stereoscopic images 
which gives the appearance of depth to objects themselves, 
as well as the appearance of depth between objects. It 
would also be desirable to be able to convert images with 

20 vertical as well as horizontal, object motion relative to 
the frame's horizontal axis. - It would also be desirable 
to be able to convert a single image. 

Summary of the Invention 

It is an object of the present invention to 
2 5 provide a method and an apparatus for converting 

monoscopic images into stereoscopic images which gives the 
appearance of depth to objects themselves, as well as the 
appearance of depth between objects. 

It is also an object of the present invention to 
30 provide a method and an apparatus for converting images 
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with vertical as well as horizontal object motion relative 
to the. fjiame 1 s horizontal axis. 

It is another object of the present invention to 
provide a method and an apparatus for converting a single 
5 image . 

These and other objects of the invention are 
accomplished in accordance with the principles of the 
invention by identifying at least one object in the 
monoscopic image with a first perspective, outlining the 

10 object to generate an outline, endowing the object with 
depth information and generating a second perspective by 
image warping the object. 

Possible applications for such a method and 
apparatus include rapid conversion of existing monoscopic 

15 movie and video media, as well as still photograph (i.e., 
single image), .libraries to stereoscopic images. 

p^ieg Description <?f the Prawjngs 

The above and other objects and advantages of 
the invention will be apparent upon consideration of the . 
20 following detailed description, taken in conjunction with 
the accompanying drawings, in which the reference 
characters refer to like parts throughout and in which: 

FIG. 1 illustrates a system for converting 
monoscopic images to stereoscopic images; 
25 FIG. 2 is an actual perspective calculation 

curve; 

FIG. 3 illustrates a second perspective image 

geometry; 

FIG. 4 illustrates a sequence of successive 
30 image frames and the image frame horizontal axis; 

FIGS. 5a and 5b show pixel sampling; 
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FIG. 6 is a modified (saturating) perspective 
calculation curve; 

FIGS. 7a and 7b illustrate the transformation of 

a cube; 

5 FIG, 8 illustrates vector clipping; 

FIG. 9a is a flow diagram of a preferred 
embodiment of the method implemented by the apparatus; and 

FIG. 9b is a flow diagram of the tweening 
process used in the method shown in FIG. 9a. 
10 The Appendix contains a listing of the symbolic 

mathematical program used to derive a generalized equation 
for shift. 

Detailed Description of the Invention 

The present invention is a method and an 
15 apparatus for converting monoscopic images to stereoscopic 
images . 

Stereoscopic images require two slightly offset 
perspective images in order to create a stereoscopic 
presentation with the appearance of depth. Most existing 
20 images stored in motion picture film, photographic or 

video media format contain only a single perspective and, 
therefore, appear flat. In order to create a three- 
dimensional image, a second perspective image must be 
obtained. 

25 The second perspective image is preferably only 

slightly offset from the first perspective image. In 
accordance with the present invention, it is possible to 
generate the second perspective image from the first 
image. A system of techniques of shifting and warping 

30 objects within the first image can be implemented to 

automate the generation of the second perspective image. 
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The technique of the present invention for 
converting monoscopic into stereoscopic images uses image 
warping techniques often used for morphing image objects 
from one shape into a different shape. Warping comprises 
5 two steps. First, the object f s outlined shape is 
transformed into a new shape. This transformation 
preferably is primarily done by pixel interpolation. The 
interpolation can be either linear (for speed) or 
quadratic (for accuracy)* Second, the pixels within the 

10 outlined shape of the image are interpolated where the 

boundary of the image outline expands or contracts. For 
stereoscopic image conversion, only pixel interpolation 
horizontal to the image frame axis (indicated by x in 
FIG. 4) is required, since the second perspective image is 

15 a slight horizontal shift' from the first perspective 

image. This simplifies the procedure of image warping and 
helps speed up the transformation calculations. . Indeed, a 
simple horizontal linear pixel interpolation can be 
achieved in -close to real-time. 

20 Objects are the components of an image which are 

manipulated to give the image depth. Examples of objects 
are tables, chairs, walls, floors, lights, people, etc. 
Objects can further be divided into sub-objects to add 
more depth. For example, a person could be broken into 

2 5 two arm, objects, a head object, a body object, and two leg 
objects . 

A frame is a single image at a specific time. 
NTSC video consists of 30 frames per second or 30 images 
per second. Sequential frames are the sequential images 
30 to be converted. 

A key frame is a specific frame or image where 
input from the user is required to help direct the 
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animation. The start and end of a new scene are key 
frames, ...Frames where objects start or stop motion are 
typically key frames. 

Key objects are the important objects in the 
5 image which will be processed using this invention. 

Clipping occurs when one object (the foreground 
object) obscures another object (the background object) . 
The portions of the background object which are obscured 
are removed or not displayed and the foreground object is 

10 displayed instead. 

To convert a series of moving images, a 
"tweening" process preferably is implemented to automate 
the outlining process. The tweening process involves 
interpolations of the vector outlined shape of all the 

15 outlined objects within the scene from one key frame ("the 
start key frame") to the next key frame .("the stop key 
frame") . The interpolation can be either linear or non- 
linear (e.g., spline) depending on accuracy and/or speed 
requirements. Only the -end points (i.e., the key frames) 

20 of the motion path for the objects need to be defined, 
significantly reducing the burden on the operator. 

In order to apply image warping to the 
stereoscopic conversion of moving images such as those 
recorded on motion picture film or video media, two sets 

25 of outlined objects are used to enable clipping. A first 
set of outlines is provided either by an automatic image 
recognition process and/or manually by an operator to 
outline vectors on all the necessary key objects within an 
image. This set of outlines is then shifted and warped 

30 through the perspective transformation based on the depth 
arrangement of the objects provided by the operator. When 
objects are outlined, a set of vectors are used to 
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represent this* When vectors (outlines) from two objects 
intersect, vector-crossovers are created. The background 
vectors should be clipped to conform to the foreground 
vectors when this happens- Vector cross-overs can result 
5 in undesirable effects, therefore, a second set of 
outlined objects is generated after the perspective 
transformation . 

As shown in FIG. 3, if the coordinates of an 
object in the left perspective image are crossed with 

10 corresponding coordinates in the right perspective image 
(i.e., each left coordinate is moved to the right of the 
corresponding right coordinate) , the result is negative 
parallax and the object appears to protrude toward the 
observer and away from the neutral plane. Conversely, if 

15 the coordinates are uncrossed (each right coordinate is 
moved to the left of the corresponding left coordinate) , 
the result is positive parallax and the object appears to 
recede . 

Whenever the foreground objects 1 vectors cross- 
20 over the background objects due to the transformation, the 
background object's vectors preferably are clipped to the 
edge of the foreground object's outline. This prevents 
any vector cross-over during the actual warping process 
which could cause unwanted warping artifacts. The entire 
25 process can be completely automated using conventional 
computer line clipping algorithms. Given two sets of 
vectors with one tagged as .the foreground and one tagged 
as the background, it is well known by someone skilled in 
the art how to automatically clip the background vectors 
30 to the foreground. Algorithms like this are used for 
hidden line removal in computer graphics. 
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FIG. 1 shows two-dimensional video media images 
comprising unprocessed still frames 2 provided to 
workstation 3 through digital image capture using video 
media frame grabber 1. Processed still frames 4 are 
5 displayed in sequence on monitor 5. 

Key objects are operator-selected foreground 
objects in a particular sequence of images. Key frames, 
which correspond to frames in which key objects change 
motion or deviate from a predicted motion path, can be 
10 identified automatically by delta pixel changes between 

frames. Delta pixel changes can also be used to determine 
the basic motion path within each scene. The key frames 
can be automatically selected based on the extreme points 
of the motion path. The key frames can also be selected 
15 by a human operator after viewing the scene. These key 
frames are then individually processed by outlining the 
key objects within the image. 

Objects can be detected automatically by an edge 
detection algorithm or manually by an operator. Automatic 
20 edge detection algorithms such as Laplacian, Sobel and 
Prewitt convoluted filters can be used to highlight the 
object's outline. Such algorithms are described, for 
example, in Christopher Watkins, Alberto Sadun, Stephen 
Marenka, "Modern image Processing: Warping, Morphing, and 
25 Classical Techniques," Academic Press Professional, Inc. 
(1993). The computer can then trace around the 
highlighted objects to form vector outlines. A vector is 
a line which connects points (i.e., the control points) on 
the object. 

30 Once vector outlines are determined for.obj.ects 

within the image, the foreground priority of objects can 
be determined by first identifying objects which are 
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enclosed within another object or objects which overlap 
another ^object. These objects are considered to be 
potential foreground objects and subject to further 
criteria such as intensity cue and vertical position cue. 
5 Key objects can be identified by the operator as 

corresponding to certain predefined objects for predefined 
profile warping. Each predefined object preferably has a 
profile identification which defines its perceived surface 
profile. This predefined profile warping eliminates the 
10 need to define vectors within an object in order to 
recreate its full volume appearance. 

The object's outline defines the area which will 
be transformed via perspective warping. Perspective 
warping is a type of image warping in which the image is 
15 horizontally shifted. Therefore, the actual 

transformation is significantly faster to compute because 
there is no vertical warping. 

The object's outline is warped and the object's 
image within the outlined area is then warped into the 
20 necessary perspective. The control points of the outline 
are transformed into their new shape and position based on 
the depth arrangements and/or the object's profile 
identification. The actual transformation only shifts the 
end points of the vectors horizontally. 
25 The amount of the shift may be based, for 

example, on the computed depth as shown in FIG. 2, which 
shows the relationship between the distance from the eyes, 
y, versus the amount of relative shift, A, at any 
horizontal point x for a fixed focus distance of 4 5 inches 
30 and an eye separation distance of 3 inches. One should 
note that this position offset distance saturates rapidly 
as the depth becomes farther away. A more generalized 
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equation was derived to" calculate A, the amount of shift 
requirscl.for the right (i.e., second) perspective image 
from the left (i.e., first) perspective image at any 
particular depth relative to the width of the viewing 
5 screen, with reference to FIG, 3. The actual derivation 
was done using a symbolic mathematical program (Maple V) . 
Maple is a computer algebra system, i.e., a computer 
program which manipulates mathematical expressions 
symbolically. Maple is able to solve equations, systems 

10 of equations and differential equations, perform 

differentiation and integration, do high precision 
arithmetic arid draw accurate graphs in two and three 
dimensions. A listing of the Maple V code is listed in 
the Appendix which follows this specification and the 

15 resulting equation is shown below: 



y — y 
old new 



s, - s, 



T, - T r 



+ S, 



20 



The calculation for the linear pixel interpolation is 
shown below: 

Red ncw [X ne J - (l-frac(X) ) •Red old [integer (X) ] + 



Green nev [X ntw 
Blue new [X new ] 



frac(X) -Red old [ integer (XJ+1J 
3 = (l-frac(X) ) •Green old [integer (X) ] + 
frac(X) •Green old [ integer (X) +1] 
(1-frac (X) ) -Blue 9ld [integer (X) ] + 
frac(X) •Blue old [integer(X)+l] 



25 



where : 



30 



X 0 id 
Si 

^new 

T 0 



Old pixel position. 

Old left pixel boundary position. 

Old right pixel boundary position. 

New sampled pixel position. 

New left pixel boundary position. 

New right pixel boundary position. 
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As shown in FIG. 5, the pixels within the 
bounda-ry^- shown in FIG. 5a are resampled to the new 
boundary shown in FIG. 5b. Since the number of pixels 
along the x axis is arbitrary, the new sampled pixels are 
5 not likely to map back to the original pixels. 

For illustration purposes, consider that the 
left image is the original image and the right image is 
generated through perspective transformation. The 
operator will then select a neutral plane within the 

10 image. The neutral plane (also referred to as the "zero- 
shifted" plane) is that plane on which no point shifts 
between the left and right perspective image. Any point 
on a plane in front of the neutral plane shifts to the 
left and any point on a plane behind the neutral plane 

15 shifts to the right. The selection of the neutral plane 
is important to minimize the maximum shift required by the 
object. The neutral plane can be selected automatically 
by choosing the center plane between the front-most object 
and the back-most object. Manual adjustment by the 

20 operator is, allowed for aesthetic reasons if the operator 
so chooses. 

Objects in front of the neutral plane appear to 
float out of the viewing screen. This can produce 
undesirable effects due to object's partial appearance at 

25 the border of the screen. This creates an. unnatural 

appearance as the object gets partially clipped by the 
border behind it instead of in front. This can be 
corrected by shifting the left and right frames 
horizontally so that the object is behind the viewing 

30 screen. 

Other perspective calculation curves, such as 
the saturating perspective calculation curve shown, in FIG. 
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6, can be used instead of the actual perspective 
calcul-afcion curve shown in FIG. 2. By using a modified 
perspective calculation curve to perform the perspective 
transformation, it is possible to avoid excessive image 
5 warping and distortion of the transformed image. A 
similar result can be achieved using the actual 
perspective calculation curve of FIG. 2 if the operator is 
prevented from setting the control points too far in front 
of the neutral plane. 

10 Once the main outlines of the object are 

determined within the scene, the object can be easily 
transformed into the second perspective image using a 
perspective transformation curve. To illustrate the 
technique, the transformation of a simple cube is shown in 

15 FIGS. 7a and 7b. FIG. 7a shows the left perspective 

image. FIG. 7b shows the right perspective image which 
results from the transformation. In this case, the main 
outlines are the edges of the cube and the control points 
are the eight corners of the cube. The control points are 

20 manipulated and depth arranged by an operator to determine 
the current position in depth. This perceived depth is 
then horizontally translated right to create the second 
perspective image. The resulting stereoscopic image can 
be displayed in quasi-real-time on a monitor to provide 

25 feedback to the operator. 

In this example, image warping based on the 
vector outline transformation is performed based on the 
left perspective image. A new set of vectors is generated 
for use in the warping procedure based on the object's 

30 depth arrangement. Any vector outlined object in the 
background which crosses vectors with the foreground 
objects will be clipped around the contour of the 
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foreground object to prevent vector crossover during the 
warping procedure, as shown in FIG. 8. Certain vectors in 
the new set of vectors are allowed to crossover when the 
distance of the crossover is sufficiently small/ thereby 
5 allowing the foreground image to fold over the background 
image . 

Since most video media or motion picture film 
frames have only minute changes from one frame to the 
next, it is therefore possible to interpolate (i.e., 

10 "tween") the in-between object outlines for frames between 
the key objects' motion frames. 

When motion picture film is converted to video 
media, the frame rate must be converted from 24 frames per 
second to 30 frames per second. One common way to do this 

15 is by making every fifth video media frame the duplicate 
of the preceding motion picture film frame. As a way of 
reducing the number of frames to be processed and 
increasing the interpolation accuracy, such redundant 
frames may be removed from video media prior to monoscopic 

20 to stereoscopic conversion. Of course, the redundancy 

must be reintroduced to the video media after processing 
is complete. 

Since there is latency in human visual depth 
perception, not every video media or motion picture frame 

25 in a sequence need be converted to a stereoscopic image. 

G.R. Engel, "An Investigation of Visual Responses to Brief 
Stereoscopic Stimuli," 22 Quarterl y Journal Of 
Experimental Psychology , pp. 148-166 (1970) . Stereoscopic 
images only need to be displayed about every 300 

30 milliseconds in order for the entire movie sequence to be 
a stereoscopic presentation which appears to be 
continuously stereoscopic. This reduces the computation 
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needed for the conversion of monoscopic motion picture 
film to ^stereoscopic motion picture film by several orders 
of magnitude and results in a much quicker and easier 
conversion. 

5 A preferred embodiment of the method of the 

present invention is shown in FIGS. 9a and 9b. Digital 
images are captured at step 10. If the digital images are 
from video media and were originally recorded on motion 
picture film, redundant frames are removed at step 30. 

10 Key objects are selected at step 40. Key frames are 

identified at step 50. Each frame between the start key 
frame and the stop key frame is tweened at step 60. 
Finally, the sequence of* stereoscopic images is displayed 
at step 70. The tweening process of step 60 begins with 

15 outlining the objects to form vector outlines at, step 100. 
The depth of objects is set at step 110. If a vector 
outlined object in the background crosses vectors with a 
foreground object, the. vectors of the background object 
are clipped at step 130. If the object corresponds to a 

20 predefined object it is transformed using a predefined 
profile warping at step i50. Otherwise, the object is 
transformed using a selected perspective calculation curve 
at step 160. Unless a stop key frame is reached, process 
returns to step 100. The tweening process is repeated for 

25 each set of start and stop key frames. 

Thus it can be seen that a method and apparatus 
for converting monoscopic images into stereoscopic images 
is provided. Although this specification describes the 
generation of a right perspective image based on a left 

30 perspective image, one skilled in the art will appreciate 
that a left perspective image can just as easily be 
generated from a right perspective image. Indeed, one 
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skilled in the art will appreciate that the present 
invention, can be practiced by other than the described 
embodiments , which are presented for purposes of 
illustration and not of limitation, and the present 
5 invention is limited only by the claims which follow. 
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WHAT IS CLAIMED IS: 



1 1. A method for converting a monoscopic image 

2 comprising a first perspective to a stereoscopic image 

3 comprising said first perspective and a second 

4 perspective, comprising the steps of: 

5 identifying at least one object in said 
.6 monoscopic image; 

7 outlining said at least one object to 

8 generate an outline; 

9 endowing said at least one object with 

10 depth information; and 

11 generating said second perspective by 

12 image warping said at least one object. 

1 2. The method of claim 1 wherein said 

2 generating step comprises: 

3 shifting points on said outline of said at 

4 least one object from said first perspective to said 

5 second perspective; and 

6 shifting points within said outline from 

7 said first perspective co said second perspective. 

1 3. The method of claim 1 wherein said 

2 generating step is performed on a sequence of successive 

3 frames of said monoscopic images to produce a stereoscopic 

4 presentation. 

1 4. The method of claim 3 wherein said 

2 sequence of successive frames is derived from motion 

3 picture film. 
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1 5. The method of claim 3 wherein said 

2 sequence^-of successive frames is derived from video media 

1 6. The method of claim 5 wherein said 

2 sequence of successive frames containis redundant frames a 

3 a result of conversion from motion picture film. 

1 7. The method of claim 6 further comprising c 

2 preliminary step of: 

3 removing said redundant frames from said 

4 sequence of successive frames. 

1 8. The method of claim 3 wherein said method 

2 is performed only on selected frames of said sequence of 

3 successive frames, thereby reducing the number of frames 

4 that must be converted to stereoscopic . images, thereby 

5 reducing computation time while providing a sequence of 

6 images which appear to be . stereoscopic . 



1 9. A method for converting a sequence of 

2 frames of monoscopic images with at least one foreground 

3 object with a depth and an outline and at least one 

4 background object with an outline to a sequence of 

5 stereoscopic images, comprising the steps of: 



6 identifying said at least one foreground 

7 object; 

8 outlining said at least one foreground 

9 object; 

10 setting said depth of said at least one 

11 foreground object; 
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12 line clipping said at least one background 

13 object if said at least one foreground object moves 

14 in front of said at least one background object; 

15 shifting points of said outline of said at 

16 least one foreground object and said outline of said 

17 at least one background object to a second image 

18 perspective; and 

19 shifting points inside said outline of 

20 said at least one foreground object and said outline 

21 of said at least one background object to a second 

22 image perspective. 

1 10. The method of claim 9 wherein said depth 

2 in said setting step may be varied in response to 

3 instructions from an operator. 

1 11. The method of claim 9 further comprising 

2 the step of displaying said sequence of stereoscopic 

3 images in near real-time. 

1 12. The method of claim 9 wherein said 

2 sequence of successive frames is derived from motion 

3 picture film. 

1 13. The method of claim 9 wherein said 

2 sequence of successive frames is derived from video media. 



1 
2 
3 



14. The method of claim 13 wherein said 
sequence of successive frames contains redundant frames as 
a result of conversion from motion picture film. 
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1 ' 15. The method of claim 14 further comprising 

2 a preliminary step of: 

3 removing said redundant frames from said 

4 sequence of successive frames. 

1 16. The method of claim 9 wherein said method 

2 is performed only on selected frames of said sequence of 

3 successive frames, thereby reducing the number of frames 

4 that must be converted to stereoscopic images, thereby 

5 reducing computation time while providing a sequence of 

6 images which appear to be stereoscopic. 

1 17. The method of claim 16 wherein said 

2 selected frames are separated by a set interval of time. 

1 18. The method of claim 17 wherein said set 

2 interval is about 300 milliseconds. 

1 19. The method of claim 9 further comprising 

2 step before said identifying step of: 

3 determining a start key frame and a stop 

4 key frame. 

1 20. The method of claim 19 wherein said 

2 shifting points of said outline step and said shifting 

3 points inside said outline step are repeated for each 

4 frame between said start key frame and said stop key 

5 frame. 



1 

2 



21. The method of claim 19, wherein said 
shifting points of said outline step and said shifting 
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3 points inside said outline step are done via non-linear 

4 interpola-tion . 

1 22. The method of claim 20 wherein said 

2 shifting points of said outline step and said shifting 

3 points inside said outline step are done via linear 

4 interpolation. 

1 23. The method of claim 9 wherein said 

2 shifting points of said outline step and said shifting 

3 points inside said outline step are done based on said 

4 depth of said at least one foreground object and a 

5 selected perspective calculation curve. 

1 24. The method of claim 23 wherein said 

2 selected perspective calculation curve is an actual 

3 perspective calculation curve. 

1 25. The method of claim 23 wherein an operator 

2 is prevented from setting said depth of said at least one 

3 foreground object significantly beyond a neutral plane. 

1 26. The method of claim 23 wherein said 

2 selected perspective calculation curve is a modified 

3 perspective calculation curve. 

1 27. The method of claim 26 wherein said 

2 modified perspective calculation curve is a saturating 

3 perspective calculation curve. 



1 28. A method for converting a monoscopic image 

2 comprising a first perspective to a stereoscopic image 
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3 comprising said first perspective and a second 

4 perspective, comprising the steps of: 

5 identifying at least one object in said 

6 monoscopic image; 

7 outlining said at least one object; 

8 endowing said at least one object with 

9 depth information; and 

10 generating said second perspective by a 

11 method selected from a horizontal shift method, a 

12 frame delay method and an image warping method/ based 

13 on direction of motion of camera and said at least 

14 one object, desired computation complexity and 

15 desired image quality. 

1 29. A recording medium on which a stereoscopic 

2 image comprising a first perspective and a second 

3 perspective is recorded, said stereoscopic image being 

4 formed from a monoscopic image comprising said first 

5 perspective by a method comprising the steps of: 

6 identifying at least one object in said 

7 monoscopic image; 

8 outlining said at least one object; 

9 endowing said at least one object with 

10 depth information; and 

11 generating said second perspective by 

12 image warping said at least one object. 



1 

2 
3 



30. A product produced by placing on a 
recording medium a stereoscopic image generated by the 
method of claims 1, 9 or 28. 
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1 31. An apparatus for converting a sequence of 

2 frames ■- of- monoscopic images with at least one foreground 

3 object with a depth and at least one background object to 

4 a sequence of stereoscopic images, comprising: 

5 a foreground object identifier; 

6 a foreground object outliner; 

7 a foreground object depth setter; 

8 a background object line clipper; and 

9 a foreground object point shifter 
10 coupled in series. 

1 32. The apparatus of claim 31 wherein said 

2 sequence of successive frames is derived from motion 

3 picture film. 

1 33. The apparatus of claim 31 wherein said 

2 sequence of successive frames is derived from video media. 

1 34. The apparatus of claim 33 wherein said 

2 sequence of successive frames contains redundant frames as 

3 a result of conversion from motion picture film. 

1 35. The apparatus of claim 34 further 

2 comprising a redundant frame remover coupled in series 

3 before said foreground object identifier. 

1 36. The apparatus of claim 31 wherein said 

2 apparatus operates only on selected frames of said 

3 monoscopic images, thereby reducing the number of frames 

4 that must be converted to stereoscopic images, thereby 

5 reducing computation time while providing a sequence of 

6 images which appear to be stereoscopic. 
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1 ^.37. The apparatus of claim 36 wherein said 

2 selected frames are separated by a set interval of time* 

1 38. The apparatus of claim 37 wherein said set 

2 interval is about 300 milliseconds. 

1 39. The apparatus of claim 31 wherein said 

2 foreground object point shifter shifts points based on 

3 said depth of said at least one foreground object and a 

4 selected perspective calculation curve. 

1 40. The apparatus of claim 39 wherein said 

2 selected perspective calculation curve is an actual 

3 perspective calculation curve. 

1 41. The apparatus of claim 39 wherein an 

2 operator is prevented* from setting said depth of said at 

3 least one foreground object significantly beyond a neutral 

4 plane. 

1 42. The apparatus of claim 39 wherein said 

2 selected perspective calculation curve is a modified 

3 perspective calculation curve. 

1 43. The apparatus of claim 42 wherein said 

2 modified perspective calculation curve is a saturating 

3 perspective calculation curve. 

1 44. The apparatus of claim 31 wherein said 

2 depth in said setting step may be varied in response to 

3 instructions from an operator. 
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1 .45. The apparatus of claim 44 wherein said 

2 sequence of stereoscopic images is displayed in near real 

3 time* 
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